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ARI  Research  Reports  and  Technical  Reports  are  intended  for  sponsors  of 
R&O  tasks  and  for  other  research  and  military  agencies.  Any  findings  ready 
for  implementation  at  the  time  of  publication  are  presented  in  the  last  part 
of  the  Brief.  Upon  completion  of  a  major  phase  of  the  task,  formal  recom¬ 
mendations  for  official  action  normally  are  conveyed  to  appropriate  military 
agencies  by  briefing  or  Disposition  Form. 


The  Army  Research  Institute  has  ongoing  responsibility  for  monitoring 
the  validity  and  utility  of  the  Armed  Services  Vocational  Aptitude  Battery 
(ASVAB)  Aptitude  Area  Composites  used  to  select  and  place  applicants  in  par¬ 
ticular  training  Military  Occupational  Specialties  (MOSs) .  With  the  dimin¬ 
ishing  available  human  resources  and  increasing  technological  aptitude  re¬ 
quirements  of  Army  duties,  review  of  enlistment  standards  has  become  essential 
to  manning  a  prepared  defense  force. 

The  present  Technical  Report  is  provided  in  response  to  a  request  from 
the  Deputy  Chief  of  Staff  for  Personnel  (DCSPER)  to  evaluate  the  aptitude 
area  composite  (clerical  [CL])  used  to  place  Army  applicants  into  clerical 
MOS  training.  The  results  suggest  that  the  addition  of  a  mathematics  com¬ 
ponent  to  the  composite  could  improve  prediction  of  training  performance. 

The  immediate  purpose  of  this  report  is  to  document  advice  provided  to  the 
DCSPER  regarding  potential  improvements  in  the  use  of  classification  tests 
in  order  to  increase  training  performance  and  to  reduce  attrition  in  Army 
schools . 


EDGAR  M.  JOHNSON 
Technical  Director 
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EVALUATION  OF  THE  ASVAB  8/9/10  CLERICAL  COMPOSITE  FOR  PREDICTING 
TRAINING  SCHOOL  PERFORMANCE 


EXECUTIVE  SUMMARY 


Requirement ; 

To  evaluate  the  composite  of  ASVAB  subtests  currently  used  to  place  Army 
applicants  into  clerical  training  schools . 


Procedure : 

Correlation  and  multiple  regression  analyses  were  used  to  produce  combi¬ 
nations  of  subtests  most  predictive  of  higher  quality  training  performance. 
Comparisons  were  made  between  the  multiple  R  for  this  optimal  set  of  predic¬ 
tors  and  that  for  the  composite  of  subtests  currently  used  for  clerical 
classification. 


Findings : 

In  9  of  the  12  MOS  samples  studied,  a  mathematics  subtest  (either  Arith¬ 
metic  Reasoning  or  Mathematics  Knowledge)  had  the  highest  single-predictor 
validity  correlation  with  course  grade  criteria.  When  the  MOS  subsamples 
were  combined,  a  composite  of  Arithmetic  Reasoning,  Paragraph  comprehension, 
and  Mathematics  Knowledge  test  scores  had  the  highest  multiple  R  (.74)  with 
the  criterion,  significantly  higher  than  the  correlation  obtained  for  the 
composite  of  subtests  currently  used  ( .68) . 


Utilization  of  Findings; 

This  report  will  be  used  by  the  Deputy  Chief  of  Staff  for  Personnel  to 
consider  modifications  of  the  clerical  aptitude  area  composite  (CL)  that 
would  raise  the  expected  performance  of  soldiers  in  clerical  occupations . 
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EVALUATION  OF  THE  ASVAB  8/9/10  CLERICAL  COMPOSITE  FOR  PREDICTING 

TRAINING  SCHOOL  PERFORMANCE 


OVERVIEW 

This  report  documents  test  validation  research  undertaken  by  the  U.S. 

Army  Research  Institute  (ARI )  at  the  direction  of  the  Army  Deputy  Chief  of 
Staff  for  Personnel.  The  research  was  designed  to  evaluate  the  effectiveness 
of  the  clerical  aptitude  area  composite  (CL)  currently  used  to  classify  sol¬ 
diers  entering  clerical  Military  Occupational  Specialties  (MOSs) .  The  cleri¬ 
cal  aptitude  area  is  a  composite  of  subtests  appearing  on  the  Armed  Services 
Vocational  Aptitude  Battery  (ASVAB)  forms  8/9/10. 

The  ASVAB  is  a  battery  of  10  subtests  (see  Table  1)  that  are  combined 
in  different  ways  for  use  as  selection  and  classif ication  composites.  One 
set  of  four  subtests  is  known  as  the  Armed  Forces  Qualification  Test  (AFQT) 
and  is  used  to  screen  applicants  for  eligibility  for  military  service. 

After  meeting  the  AFQT  criterion  for  selection,  an  Amy  applicant  must 
achieve  a  passing  score  on  an  aptitude  area  composite  for  placement  into 
a  particular  training  specialty. 

For  clerical  training,  the  Army  uses  the  clerical  composite  (CL) ,  which 
consists  of  the  four  subtests  of  Word  Knowledge  (WK) ,  Paragraph  Comprehension 
(PC) ,  Numerical  Operations  (NO) ,  and  Coding  Speed  (CS) .  Sample  items  for  each 
of  the  10  ASVAB  subtests  are  given  in  Appendix  A. 

Recent  emphasis  in  Army  training  has  been  on  criterion-referenced  testing, 
which  has  produced  dichotomous  pass/fail  scores  (Maier,  19B1) .  Such  scores 
do  not  display  adequate  variance  among  individuals  to  reflect  differences  in 
levels  of  performance.  The  training  criteria  used  in  this  report  were  part 
of  a  special  data  collection  undertaken  to  obtain  continuous  criterion  scores 
suitable  for  validation. 

The  purposes  of  this  research  were  (1)  to  validate  the  operational  cleri¬ 
cal  composite  of  ASVAB  8/9/10  subtests  against  school  performance  in  Army 
entry-level  enlisted  clerical  MOSs,  and  (2)  to  identify  and  evaluate  possible 
alternative  composites  that  can  predict  clerical  training  school  performance. 


BACKGROUND 

The  current  CL  composite  has  evolved  from  a  series  of  research  projects 
on  enlisted  classification  conducted  since  World  War  II.  Table  2  presents  a 
summary  of  relevant  validation  research  on  the  clerical  MOS.  The  earliest 
composite  used  to  classify  Army  clerical  positions  consisted  of  a  reading 
vocabulary  test,  an  arithmetic  reasoning  test,  and  a  coding  speed  test.  This 
reflected  job  analysis  (Trump..  Marion,  &  Karcher,  1957)  ,  which  found  that 
perceptual  speed,  number  facility,  memory,  and  perceptual  patterning  were  the 
important  components  in  clerical  jobs. 

At  the  beginning  of  World  War  II,  a  general  ability  construct  was  con¬ 
sidered  most  predictive  of  performance  in  training  (PRS  808,  1947).  Later, 
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Table  1 


Description  of  the  Subtests  in  ASVAB  d/9/lo 


Sub test  name 

Content 

Number 

of 

items 

Test 

time 
(min . ) 

Word  Knowledge  (WK) a 

Understanding  the  meaning 
of  words,  i.e.,  vocabulary 

35 

11 

Arithmetic  Reasoning  (AR)a 

Word  problems  emphasizing 
mathematical  reasoning 
rather  than  mathematical 
knowledge 

30 

30 

a 

Paragraph  Comprehension  (PC) 

Understanding  the  meaning 
of  paragraphs 

15 

13 

Numerical  Operations  (N0)a 

A  speeded  test  of  four 
arithmetic  operations: 
addition,  subtraction, 
multiplication,  and 
division . 

50 

3 

General  Science  (GS) 

Knowledge  of  the  physical 
and  biological  sciences 

25 

11 

Electronics  Information  (El) 

Knowledge  of  electronics 
and  radio  principles 

25 

24 

Mathematics  Knowledge  (MK) 

Knowledge  of  algebra, 
geometry,  and  fractions 

25 

24 

Auto-Shop  information  (AS) 

Knowledge  of  auto  mechan¬ 
ics,  shop  practices,  and 
tool  functions 

25 

11 

Coding  Speed  (CS) 

A  speeded  test  of  matching 
words  and  numbers 

84 

7 

Mechanical  Comprehension  (MC) 

Understanding  mechanical 
principles  such  as  gears, 
levers,  and  pulleys 

25 

19 

& 

Tests  in  Armed  Forces  Qualification  Test  (AFQT) . 
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as  the  available  labor  force  pool  decreased,  test  developers  attempted  to 
design  composites  that  would  tap  aptitudes  (such  as  perceptual  speed)  that 
would  be  relevant  to  specific  occupational  skills. 

When  the  aptitude  area  system  was  reconstituted  in  1958,  each  composite 
contained  only  two  tests,  one  measuring  general  ability  and  one  measuring  a 
specializad  aptitude.  For  clerical  positions,  the  composite  was  Verbal 
(VE)  +  Army  Coding  Speed  (ACS)  (Maier  &  Fuchs,  J969)  .  When  the  composites 
were  again  reevaluated  in  .1969,  additional  tests  were  added  to  improve  the 
validity  of  the  composites,  again  making  their  content  more  general  (Maier  & 
Fuchs,  1972).  The  testing  philosophy  of  this  time  reflected  a  desire  to 
distribute  general  mental  ability  equitably  across  all  the  MOS  groups  and 
to  use  the  classification  composites  as  a  secondary  screen  for  applicants 
of  marginal  ability. 

Although  the  composition  of  the  subtests  and  their  relative  weighting 
in  the  clerical  composite  varied  over  the  years  ,  the  same  aptitude  dimensions 
(verbal,  math,  clerical  speed)  were  included  until  about  1973.  At  that  time, 
a  new  classification  system  was  inaugurated.  For  the  new  battery,  the  Army 
Classification  Battery-1973  (AC&-73) ,  the  aptitude  area  composites  were  con¬ 
structed  to  have  maximum  absolute  validity  for  predicting  training  perfor¬ 
mance.  Each  composite  had  at  least  one  test  of  general  ability;  at  least 
two  of  the  subtests  in  each  composite  required  the  ability  to  read.  However, 
tht  cost  of  building  literacy  into  each  composite  was  that  the  composites 
were  hiqhly  intercorrelated. 

The  same  aptitude  composites  developed  for  ACB-73  were  also  used  for 
ASVAB  6/7,  introduced  in  1976.  For  the  current  forms  (ASVAB  8/9/10),  Maier 
and  Grafton  (1981)  built  new  aptitude  area  composites  by  using  parallel  pre¬ 
dictor  subtests  from  ASVAB  6/7  and  validating  against  measures  of  job  pro¬ 
ficiency  and  training  success . 

Research  on  clerical  jobs  in  the  civilian  sector  has  found  results  simi¬ 
lar  to  those  from  research  in  the  military.  In  the  Federal  Civil  Service, 
for  example,  clerical  workers  have  been  selected  using  a  test  that  included 
vocabulary,  paragraph  comprehension,  alphabetizing,  simple  mathematics,  and 
typing  scales  (U.S.  Civil  Service  conmission,  1973).  In  an  early  review, 
Bennett  and  Cruikshank  (1949)  concluded  that  the  best  predictor  for  clerical 
occupations  was  a  test  of  general  mental  ability  in  combination  with  a  test 
of  perceptual  speed.  Validation  research  in  the  clerical  area  has  generally 
found  validity  coefficients  between  such  test  scores  and  training/job  success 
to  be  quite  high.  Ghiselli  (1966)  reported  that  test  validities  for  profi¬ 
ciency  and  training  criteria  in  clerical  occupations  were  on  the  order  of 
.75  across  test  types.  Pearlman  (1979)  collected  nearly  3,400  validity  co¬ 
efficients  from  700  studies  involving  a  total  sample  size  of  over  470,000. 

For  training  performance  criteria,  he  found  higher  corrected  mean  validities 
for  measures  of  verbal  ability  (£  =*  .65) ,  quantitative  ability  (r  =  .71) , 
reasoning  ability  (£  •»  ,40)  ,  memory  (£  *  .59)  ,  and  perceptual  speed  (r  «  .40) 
than  for  such  measures  as  motor  ability  (£  =  .35)  and  spatial  ability 
(£  ■  .38)  .  This  may  be  due  to  the  relatively  academic  orientation  of  most 
clerical  training  programs. 

The  impetus  for  the  current  validation  effort  stems  from  recent  empha¬ 
sis  on  optimizing  the  use  of  the  Army's  personnel  resources.  Because  of  the 
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large  number  of  clerical  soldiers  the  Army  trains  each  year  (18,000  in  Fis¬ 
cal  Year  1981  [FY81])  ,  even  modest  increments  in  validity  can  have  a  dramatic 
payoff  in  monetary  savings  attributable  to  higher  performance  and  lower 
training  attrition  costs. 


METHOD 


Subjects 


Subjects  were  3,978  new  trainees  entering  the  Army  for  clerical  training 
in  FY  81.  Only  subjects  having  ASVAB  8/9/10  scores  on  record  were  used  be¬ 
cause  previous  forms  of  the  ASVAB  were  not  being  validated  in  this  research. 
Twelve  of  the  20  MOSs  that  use  CL  for  classification  were  represented  in  this 
sample;  the  remaining  8  specialties  had  to  be  excluded  because  of  either 
small  sample  size  or  inadequate  variance  in  the  criterion  measures.  Table  3 
describes  the  12  MOS  subsamples  and  shows  sample  sizes  as  well  as  predictor 
and  criterion  means  and  standard  deviations  (SDs)  . 


Measures 

Predictors .  Predictor  measures  were  the  10  ASVAB  subtest  scores,  which 
were  transformed  to  standard  scores  using  a  standard  Army  conversion  table. 
Table  1  provides  a  description  of  these  subtests . 

Criteria.  End-of-course  grades  were  used  to  measure  training  perfor¬ 
mance.  These  scores  were  standardized  within  each  MOS  to  permit  comparison 
across  MOSs.  Disposition  categories,  such  as  graduates,  recycles  (who  retake 
the  same  course) ,  transfers  (who  attempt  training  in  a  different  course) ,  and 
failures,  were  used  to  set  replacement  scores  as  defined  below.  The  graduate/ 
nongraduate  dichotomy  was  used  as  a  secondary  performance  criterion  for 
validation. 


Procedures 

Data  were  edited  to  remove  certain  cases:  scores  for  students  who  did 
not  complete  training  for  medical  or  disciplinary  reasons,  scores  that  were 
out  of  range,  and  repeated  measures  on  students  who  recycled  through  training. 
A  score  replacement  technique,  following  a  rationale  developed  by  Maier 
(1968),  was  used  to  reduce  the  error  variance  in  criterion  scores.  Since 
the  score  of  record  for  a  student  who  failed  to  complete  the  course  may  have 
represented  only  a  partial  score  achieved  up  to  that  point  in  training, 
scores  for  recycles,  transfers,  and  reliefs  were  replaced.  A  recycle  is  a 
student  who  attempts  training  in  the  same  course  a  second  time;  a  transfer 
is  a  student  who  is  moved  to  a  different  course  of  training;  and  a  relief  is 
a  student  who  is  discharged  without  further  attempts  at  training. 

For  recycles ,  a  score  that  was  one-half  standard  deviation  below  the 
mean  of  the  graduates  was  substituted  for  the  score  of  record.  For  reliefs 
and  transfers,  a  score  that  was  one  standard  deviation  below  the  mean  was 
substituted.  About  5%  of  the  total  sample  was  involved  in  a  substitution 
of  this  type . 
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Sample  Clerical  MOS  Predictor  and  Criterion 
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Having  standardized  and  edited  the  scores ,  we  then  computed  covariance 
matrices  and  corrected  the  subtest-course  grade  correlations  for  restriction 
in  range  of  the  predictor  scores  using  a  method  described  by  Lord  and  Novick 
(1968).  For  an  unrestricted  population  reference,  the  correlation  matrix 
derived  from  the  1980  Profile  of  American  Youth  (Wagner,  1982)  was  used  (see 
Appendix  C) .  No  other  corrections  were  made . 

A  final  procedural  decision  was  how  best  to  combine  the  information 
from  the  12  individual  MOS  regressions .  Two  methods  of  weighting  the  sub¬ 
samples  were  compared:  one  weighted  the  12  MOSs  equally;  the  other  weighted 
by  the  MOS  sample  size,  which  reflected  MOS  accession  size. 


Analyses 


Descriptive  statistics  (means,  standard  deviations)  for  each  MOS  were 
calculated  for  the  predictor  (CL)  and  criterion  (course  grade) .  Frequency 
distributions  were  examined  for  normality,  skew,  and  kurtosis.  Multiple 
correlation  and  regression  analyses  were  performed  for  each  MOS  and  for  the 
total  combined  sample  to  predict  course  grades  from  ASVAB  subtest  scores. 
The  corrected  covariance  matrices  were  used  to  derive  regression  equations 
using  stepwise  procedures  (Hull  &  Nie,  1981)  .  The  multiple  correlation  be¬ 
tween  the  current  composite  (WK  +  PC  +  CS  +  NO)  and  criterion  scores  was 
compared  with  that  for  an  alternate  unit-weighted,  revised  composite  sug¬ 
gested  by  the  regression  analyses.  The  stability  of  the  regressions  was 
tested  by  dividing  the  two  largest  MOSs  in  half  randomly  and  developing  a 
prediction  equation  on  one-half  of  the  sample  and  cross-validating  on  the 
other  half. 


Differential  prediction  by  sex  was  examined  by  comparing  the  slopes, 
intercepts,  and  standard  errors  of  estimate  of  regression  lines  developed 
separately  for  males  and  females.  These  lines  were  computed  from  a  unit- 
weighted  composite  of  predictors — Arithmetic  Reasoning  (AR) ,  Paragraph  Com¬ 
prehension  (PC),  and  Mathematics  Knowledge  (MK) — regressed  against  course 
grade.  Subgroup  analyses  by  race  were  not  performed  because  of  ambiguity 
in  the  coding  of  racial  categories. 

For 'the  pass/fail  criterion,  simple  chi-square  analyses  were  performed 
to  evaluate  the  predictors'  ability  to  separate  students  who  successfully 
complete  training  from  those  who  do  not. 


Utility  analyses  were  modeled  after  Brogden  (1946)  and  Cronbach  and 
Gleser  (1965)  following  an  equation  developed  by  Hunter  and  Schmidt  (1982) 
for  computing  the  potential  utility  of  a  selector  by  means  of  a  continuous 
criterion.  Here,  the  value  of  an  increase  in  performance  (AU)  due  to  use 
of  a  valid  test  is  a  function  of  the  number  selected  (N.)  ,  the  validity  co¬ 
efficient  (Rjjy)  ,  the  average  standard  score  on  the  test  for  those  selected 
(Z*)  ,  and  the  standard  deviation  of  criterion  performance  in  dollars  (SD„) 
(Hunter  &  Schmidt,  1982)  .  It  is  assumed  that  the  relationship  between  the 
test  scores  and  training  performance  is  linear. 

The  total  productivity  gain  is 

AU  =  N  R  SD  Z  . 

-  -  -xy_  — jr.  -x 
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RESULTS 


Inspection  of  the  frequency  distributions  of  standardized  course  grades 
revealed  that,  as  might  be  expected  in  criterion-referenced  testing,  the 
grade  distributions  were  negatively  skewed.  This  skew  may  be  a  result  of 
the  schools '  use  of  criteria  that  maximized  the  proportion  of  students  who 
successfully  completed  training.  Because  no  attempt  was  made  to  normalize 
the  distributions,  the  obtained  validities  may  underestimate  the  true 
relationships . 

Table  4  presents  the  results  of  the  correlation,  regression  analyses, 
and  composite  comparisons.  All  coefficients  reported  have  been  corrected 
for  restriction  in  range.  Part  A  of  Table  4  lists  the  correlation  between 
each  of  the  individual  subtests  and  the  course  grade  criterion  for  the  desig¬ 
nated  MOS.  The  highest  single  predictor  validities  were  observed  for  the  AR 
and  MK  subtests.  For  the  total  sample,  AR  alone  predicted  training  school 
course  grades  as  efficiently  (r  =  .69)  as  the  four  subtests  of  the  current 
composite  (r_  =  .68)  .  Lowest  subtest  validities  were  found  for  Auto-Shop 
Information  (AS)  and  Electronics  Information  (El) . 

Part  B  of  Table  4  displays  the  results  cf  the  multiple  regressions,  us¬ 
ing  the  Statistical  Package  for  Social  Sciences  (SPSS)  forward  regression 
method.  For  example,  for  MOS  71D,  WK  correlated  .49  with  course  grade;  next 
MK  entered  the  regression,  increasing  the  multiple  correlation  to  .52,  fol¬ 
lowed  by  AS,  and  so  forth.  The  multicollinearity  of  ASVAB  subtests  makes 
interpretation  of  the  regressions  problematical.  However,  a  common  result 
across  9  of  the  12  individual  MOS  regressions  was  that  a  mathematics  (either 
AR  or  MK)  subtest  consistently  accounted  for  the  most  variance  in  course 
grades.  Simply  adding  AR  to  the  current  composite  raised  its  validity  from 
.68  to  .73. 

In  an  effort  to  locate  the  best  composite  for  all  12  MOSs,  we  combined  , 

the  results  of  the  individual  MOS  validations .  Since  the  relative  importance  J 

of  the  individual  MOS  was  not  determined  a  priori,  two  weighting  methods  were 
compared  for  pooling  data  across  MOSs :  weighting  MOSs  by  sample  size  and 
weighting  the  MOSs  equally.  Results  of  both  of  the  pooled-sample  regressions 
(SPSS  stepwise  method)  were  quite  similar  for  either  method  of  weighting  MOS 
subsamples.  A  composite  of  three  subtests — AR,  PC,  and  MK — predicted  ap¬ 
proximately  50%  of  the  variance  in  course  grades,  with  multiple  R  =  .74. 

This  multiple  correlation  depends  on  equalizing  the  means  of  the  12  MOSs 
and  using  beta-weighted  predictors  in  the  regression  equation.  By  compari¬ 
son,  the  subtests  of  the  current  composite  (WK,  PC,  CS ,  NO)  correlated  sig¬ 
nificantly  (£  <  .01)  lower  (.68)  with  course  grades. 

Using  the  utility  formula,  AtJ  =  N  Ryy  SD„  Z^,  the  savings  attributable 
to  using  an  improved  CL  composite  can  be  estimated  by  substituting 

R  =  .68  (for  existing  CL  composite) 

R  =  .74  (for  improved  composite) 

SD  =  $1,000;  Z  =  1;  N  =  18,000 
— Z  -x  — 

where  N  is  the  number  of  clerical  accessions  in  FY  81.  The  value  of  per¬ 
formance  SDy  was  not  determined  empirically  but  was  inferred  to  be  $1,000, 
based  on  estimates  of  training  performance  in  similar  clerical  positions 
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(Hunter  &  Schmidt,  1982).  Assuming  selection  is  made  at  .3  SD  above  the 
mean  (Z  =  .3,  <$  =  .381,  £  =  .382,  Z*  =  1)  and  projecting  these  figures  on 
future  clerical  accessions,  the  potential  savings  to  the  Army  for  increas¬ 
ing  validity  from  the  .68  of  the  current  composite  to  .74  for  the  new  com¬ 
posite  is  more  than  $1  million  each  year  the  improved  composite  is  used. 

Operationally,  unit-weighted  composites  have  generally  been  preferred 
to  the  less  stable  beta-weighted  composite  scores.  To  evaluate  the  predic¬ 
tion  using  unit-weighted  subtests,  the  correlation  between  obtained  course 
grades  and  those  predicted  from  a  unit-weighted  composite  of  AR,  PC,  and  MK 
were  compared  to  similar  correlations  using  the  CL  subtests  (WK,  PC,  CS,  and 
NO) .  These  correlations  are  listed  in  the  lower  section  of  Table  4  to  show 
the  composites'  relative  predictive  efficiency  across  the  12  MOS  samples. 

MOS  75B,  for  example,  had  the  lowest  multiple  correlation  coefficient;  76J 
had  the  highest.  The  revised  composite  improved  prediction  in  7  of  the  12 
MOSs  but  did  not  significantly  alter  the  rank  order  of  the  multiple  corre¬ 
lation  coefficients  of  the  12  specialties.  Cross-validation  in  two  large- 
sample  MOSs  obtained  corrected  correlations  of  .52  for  76C  and  .68  for  76P. 

The  check  for  differential  prediction  by  sex  revealed  that,  at  lower 
composite  scores,  the  regression  line  of  a  unit-weighted  composite  of  AR  + 

PC  +  MK  against  course  grade  for  females  lay  above  the  regression  line  for 
males  (see  Figure  1) ,  suggesting  possible  underprediction  for  women  scoring 
below  the  composite  mean.  The  following  male  and  female  subgroup  statistics 
were  significantly  different  (£  <  .01)  :  validities  (r,,,  =  .396,  rf  =  .316)  , 
predictor  SDs  (om  =  10.1,  of  =  9.08)  and  criterion  SDs~~(om  =  19. 97,  = 

19.68) .  The  difference  in  standard  errors  of  estimate  of^the  two  groups 
itf  =  18.68;  em  =  18.29)  surpassed  the  chance  level  (£  =  1.043,  df  =  3,145,835, 
p  .01)  ,  perhaps  because  of  the  large  sample  size.  However,  the  two  regres¬ 
sion  lines  did  not  differ  significantly  in  slopes  or  intercepts.  Stepwise 
regression  for  females  (ri  =  836)  produced  the  predictors  MK,  AR,  and  NO  for 
a  corrected  multiple  R  of  .40,  while  the  regression  for  males  (_n  =  3,147) 
produced  AR,  AS,  and  MK  for  a  multiple  R  of  .42.  Two  of  the  subtests,  AR 
and  MK,  are  common  to  the  regressions  for  both  sexes.  Differences  in  the 
third  predictor  as  well  as  the  absence  of  PC  may  be  attributable  to  subtest 
multicollinearity . 

The  second  performance  criterion,  the  dichotomous  pass/fail  separation, 
was  analyzed  using  chi-square  tests.  Schools  were  found  to  vary  greatly  in 
their  attrition  rates  (see  Table  5) .  Some  reported  virtually  no  attrition 
(76W,  73C)  while  others  (75D,  75E)  had  more  than  20%  attrition.  Schools 
also  differed  in  disposition  methods,  for  example,  whether  a  student  having 
been  unsuccessful  in  completing  course  requirements  recycled  through  the 
same  course  or  attempted  other  training. 

To  evaluate  whether  composite  scores  could  distinguish  between  students 
who  complete  training  successfully  and  those  who  fail,  composite  score  dis¬ 
tributions  for  graduates  and  nongraduates  were  compared .  Here ,  graduates 


include  both  regular  and  accelerated  graduates,  and  nongraduates  include 
any  students  who  recycled,  transferred,  or  were  relieved  from  duty.  Using 
the  current  CL  composite  subtests,  significant  differences  between  graduates 
and  nongraduates  were  found  for  two  MOSs;  71D  (x2  =  17.4,  £  <  .003)  and  75E 
(X2  =  12.7,  £  <  .03)  .  When  an  alternative  composite  of  AR,  PC,  and  MK  was 
used,  significant  differences  were  found  for  5  of  the  12  MOSs:  71D 


(x2  *=  22.8,  £  <  .0001)  ,  71M  (x2  =  26.6 .  £  <  .0001)  ,  75D  (x2  =  12.5,  £  <  .01)  , 
75E  (x2  =*  28.2,  £  <  .0001),  and  76C  (x2  “  45.9,  £  <  .0001).  Despite  these 
significant  chi-squares,  the  overlap  of  composite  distributions  for  total 
sample  graduates  and  nongraduates  is  high  (see  Figure  2) . 


Table  5 

Failure  Rate  by  MOS 


MOS 

N 

%  Attrition*1 

Recycles 

Reliefs 

Transfers 

7lD 

103 

17.1 

1.0 

16.1 

71M 

98 

4.1 

4.1 

7  IN 

131 

11.5 

3.4 

7.6 

73C 

214 

0.5 

0.5 

75B 

525 

3.8 

1.0 

2.8 

75C 

101 

— 

75D 

238 

21.8 

5.5 

15.6 

0.8 

75E 

296 

25.9 

0.3 

0.3 

25.3 

76C 

1,215 

6.3 

6.3 

76J 

99 

7.0 

2.0 

5.0 

76P 

618 

0.7 

0.7 

76W 

340 

— 

Total 

3,978 

6.9 

because 

of  inability 

to  comprehend 

course  material . 

DISCUSSION 

This  research  has  shown  the  importance  of  mathematics  aptitude  in  cleri¬ 
cal  training  school  performance.  The  results  are  consistent  with  previous 
validation  research  on  clerical  MOSs.  In  constructing  the  ASVAB  8/9/10  com¬ 
posites,  Maier  and  Grafton  (1981)  found  that  AR  was  amonc  the  four  subtests 
most  predictive  of  training  and  job  performance  in  Army  clerical  occupations 
However,  at  that  time  it  was  considered  important  for  all  the  military  ser¬ 
vices  to  use  the  same  predictors  whenever  feasible,  and  the  other  services 
preferred  to  avoid  a  heavy  quantitative  ioading  for  the  clerical  areas.  It 
was  decided  that  the  Army  would  use  the  same  subtests  that  the  Air  Force  and 
Marine  Corps  used  to  classify  clerical  personnel  (i.e.,  WK,  PC^  NO,  and  CS) . 
The  reported  loss  in  validity  related  to  the  Skill  Qualification  Test  (SQT) 
and  training  performance  criteria  was  3  points,  from  .58  to  .55  excluding  AR 
(Maier  &  Grafton,  1981) .  More  recent  ASVAB  validation  research  has  also 
found  AR  to  be  important  in  predicting  clerical  performance  (Maier,  1982)  . 

The  speeded  tests,  CS  and  NO,  were  not  found  to  be  as  predictive  of 
clerical  performance  as  would  be  expected  from  a  conceptual  analysis  of  the 
job  tasks.  This  may  result  from  attenuation  due  tc  unreliability  of  these 
subtests  in  operational  use.  Compared  to  power  tests,  the  speeded  tests 


Figure  2.  Frequency  percent  distribution  of  AR 


are  subject  to  additional  error  variance  because  of  timing  and  practice  ef¬ 
fects  that  tend  to  reduce  their  test-retest  reliability.  McCormick  and  his 
associates  (1982)  found  that,  when  applicants  were  allowed  to  retest  repeat¬ 
edly,  scores  of  speeded  tests  showed  the  greatest  improvement.  An  ongoing 
research  project  at  the  Army  Research  Institute  will  investigate  methods  that 
would  permit  accurate  and  reliable  measurement  of  job-relevant  perceptual 
skills. 

Although  the  utility  analyses  revealed  that  substantial  potential  sav¬ 
ings  might  be  possible  from  modifying  the  CL  composite,  the  design  of  all 
Army  aptitude  area  composites  must  be  considered  within  the  total  context 
of  all  the  positions  to  be  filled.  While  a  composite  of  AR,  PC,  and  MK  is 
suggested  as  an  efficient  predictor  of  training  performance,  possible  oppor¬ 
tunity  costs  of  loss  in  differential  prediction  must  also  be  considered. 

While  the  Arithmetic  Reasoning  test  can  predict  training  success  gen¬ 
erally,  it  may  be  less  suitable  for  classification  purposes  than  a  specific 
predictor  such  as  clerical  speed  or  psychomotor  skill,  since  the  AR  test 
would  probably  predict  success  equally  well  in  many  different  areas.  ASVAB 
AR  items  appear  to  tap  a  general  problem-solving  aptitude  in  which  the  arith¬ 
metic  operations  are  not  explicit  but  are  left  to  the  subject  to  choose. 

These  skills  may  be  more  general  than  the  arithmetic  operations  called  for 
in  the  mathematics  knowledge  subtest.  However,  adding  AR  would  increase  the 
intercorrelations  among  the  existing  classification  composites  since  it  is 
already  part  of  four  of  the  composites  in  addition  to  the  selector  composite. 
While  overall  systems  optimization  cannot  be  effected  in  any  single  research 
project,  ongoing  ARI  research  is  designed  to  address  the  best  structure  of 
all  ASVAB  Aptitude  Area  Composites  using  a  large  sample  of  Army  MOSs  and  a 
variety  of  performance  criteria.  In  the  interim,  it  appears  the  composite 
identified  by  this  research  (AR  +  PC  +  MK)  is  the  most  valid  ASVAB  composite 
for  clerical  soldiers . 
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APPENDIX  A 


SAMPLE  ASVAB  QUESTIONS 
(Adapted  from  DoD  1304.12Z) 


GS  General  Science 

Water  is  an  example  of  a  a)  solid  b)  gas  o)  liquid  d)crystal 


AR  Arithmetic  Reasoning 

A  person  buys  a  sandwich  for  50c ,  soda  for  25c  ,  and  pie  for  4(fc  . 

What  is  the  total  cost? 

a)  $1.00  b)  $1.05  c)  $1.15  d)  $1.25. 


WK  Word  Knowledge 

Small  most  nearly  means 

a)  sturdy  b)  round  o)  cheap  d)  little. 


PC  Paragraph  Comprehension 

The  duty  of  the  lighthouse  keeper  is  to  keep  the  light  burning 
no  matter  what  happens,  so  that  ships  will  be  warned  of  the 
presence  of  dangerous  rocks.  If  a  shipwreck  should  occur  near 
the  lighthouse  even  though  he  would  like  to  aid  in  the  resuce 
of  its  crew  and  passengers,  the  lighthouse  keeper  must 

a)  stay  at  his  light  b)  rush  to  their  aid  c)turn  out  the  light 
d)  quickly  sound  the  siren. 


NO  Numerical  Operations 
2  +  3  * 

a)  1  b)  4  c)  5  d)  6 


CS  Coding  Speed 

Key 

green  ....  2715  man  ....  3451  salt  ....  4586 

hat . 1413  room,  .  .  ,  2864  tree  ....  5972 


Answers 


room 

green 

tree 


1413 

2715 

2715 


2715 

2864 

2864 


AS  Auto  and  Shop  Information 


The  most  commonly  used  fuel  for  running  automobile  engines  is 
a)  kerosene  b)  benzene  c)  crude  oil  d)  gasoline. 


MK  Math  Knowledge 

If  a  ♦  6  =  7  then  a  is  equal  to 
a)  0  b)  1  c)  -1  d)  7/16. 


Which  of  the  other  gears  is  moving  in  the  same  direction  as 
gear  2? 

a)  Gear  1  b)  Gear  3  e)Neither  of  the  other  gears 
d)  Both  of  the  other  gears. 

El  Electronics  Information 

What  does  the  abbreviation  a.c.  stand  for? 

a)  additional  charge  b)  alternating  coil 

c)  alternating  current  d)  ampere  current 
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APPENDIX  B 


DESCRIPTION  OF  JOB  DUTIES  FOR  SAMPLE  CLERICAL  MOS 
(Adapted  from  AR  611-201) 


71D  LEGAL  CLERK 

Prepares  legal  correspondence,  records,  and  related  papers,  such  as 
courts-martial,  courts  of  inquiry,  and  investigations  using  knowledge 
of  Uniform  Code  of  Military  Justice,  Manual  for  Courts -Mart ial , 

Manual  of  the  Judge  Advocate  General. 

71M  CHAPEL  ACTIVITIES  SPECIALIST 

Performs  chapel  and  religious  support  functions,  such  as  religious 
services,  counseling,  and  education  as  well  as  general  administration 
and  typing  duties. 

71N  TRAFFIC  MANAGEMENT  COORDINATOR 

Assists  in  receiving,  storing,  loading,  quipping,  and  unloading  supplies 
equipment,  household  goods,  and  personal  effects.  Prepares  forms 
and  maintains  records  covering  inbound  and  outbound  shipments,  recording 
quantity  and  condition  of  property,  claims  for  adjustments  for  property 
lost  or  damaged  in  shipment. 

73C  FINANCE  SPECIALIST 

Performs  duties  pertaining  to  pay,  leave,  travel  and  maintenance  of 
personnel  finance  records  of  military  personnel  and  other  finance 
functions,  such  as  quality  edit,  disbursing  aid  travel,  and  general 
administrat ion . 

75B  PERSONNEL  ADMINISTRATION  SPECIALIST 

Performs  personnel  and  administrative  functions  such  as  personnel 
actions,  personnel  accountability  (SIDPERS),  typing,  and  general 
administration . 

75C  PERSONNEL  MANAGEMENT  SPECIALIST 

Participates  in  occupational  classification  and  management  of  manpower 
resources,  such  as  assignment,  replacement,  promotion,  reduction, 
classification,  evaluation,  testing,  as  well  as  typing  and  general 
administration. 

75D  PERSONNEL  RECORDS  SPECIALIST 

Maintains  officer  and  enlisted  personnel  records  in  records  section 
of  personnel  activity,  to  include  in/out  processing,  personnel 
records  maintenance,  and  preparation  of  SIDPERS  input  and  control  data. 
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75E  PERSONNEL  ACTIONS  SPECIALIS1 


Processes  personnel  actions  concerning  service  members  and  their 
dependents,  counseling  and  referring  individuals  to  appropriate  support 
facilities,  preparing  documentation  for  reenlistment,  discharge 
certificates,  casualty  reports. 

76C  EQUIPMENT  RECORDS  &  FARTS  SPECIALIST 

Performs  duties  involving  supply  of  repair  parts  and  maintenance  of 
equipment  records.  Receives,  stores,  and  issues  repair  parts.  Initiates 
and  keeps  records  on  equipment  use  and  operation. 

76J  MEDICAL  SUPPLY  SPECIALIST 

Performs  requisitioning,  receipt,  inventory  management,  storage, 
preservation,  issue,  salvage,  stock  control  and  accounting  of  medical 
supplies  and  equipment. 

76P  MATERIAL  CONTROL  AND  ACCOUNTING  SPECIALIST 

Performs  management  or  stock  record  functions  pertaining  to  receipt 
distribution,  and  issue  of  Class  II,  IV,  VI,  vn  and  IX  material. 
Performs  accounting,  editing,  document  control,  record  keeping, 
sales,  and  direct  exchange  of  such  material. 

76W  PETROLEUM  SUPPLY  SPECIALIST 

Operates  and  maintains  storage  and  transfer  equipment  for  petroleum 
products.  Distributes  petroleum  by  connecting  tanks,  operating  pump 
engines,  and  opening  valves  to  transfer  petroleum.  Reads  meters  and 
gauges  and  verifies  amount  and  type  of  petroleum  in  storage. 
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APPENDIX  C 


Intercom  lationt  Between  ASVAB  Subtests  for 
Profile  Study  Semple 

(N-9173) 


ASVAB  Subttft 


AR 

WK 

PC 

NO 

GS 

CS 

AS 

MK 

MC 

El 

AR 

•• 

WK 

.71 

- 

K 

.87 

.10 

- 

NO 

.63 

.80 

.60 

- 

GS 

.72 

.80 

.69 

.82 

- 

CS 

.81 

.88 

.86 

.70 

.45 

- 

AS 

.83 

.82 

.42 

ja 

.64 

22 

- 

MK 

J3 

.67 

.84 

.62 

.68 

.82 

.41 

- 

MC 

.68 

.S9 

.82 

M 

.70 

.33 

.74 

.60 

« 

El 

.18 

.88 

J7 

.41 

.76 

M 

.78 

.68 

.74 

• 

AR  *  Arithmetic  Rationing  CS 

WK  .  Word  Knowledge  AS 

K  ■  toagnph  Comprehension  MK 

NO  ■  Numoricol  Oparations  MC 

OS  •  General  Science  El 


*  Coding  Spaed 

*  Auto  and  Shop  Information 

*  Mathematics  Knowledge 

■  Mechanical  Comprahtntion 
“  Electronics  Information 


Source ;  Profile  of  American  Youth,  1980  Nationwide  Administration  of  the 

Armed  Services  Vocational  Aptitude  Battery,  Office  of  the  Assistant 
Secretary  of  Defense  (MRA&L) ,  March  1982. 


